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INTRODUCTION 



During the late 1950*8 and the 1960*8, it was antici- 
pated by some of its more ardent advocates that programed 
learning and teaching machines would significantly mitigate 
the effects of individual differences upon learning. It 
was hypothesized that small steps and immediate knowledge 
of results , coupled with self-pacing would absorb the 
effects of individual differences in learner characteristics , 
resulting in achievement crowding at the 90 to 100 percent 
level for most learners. 

Subsequent research in programed instruction has not 
borne out this hypothesis. On the contrary, the research 
has tended to show that the same positive correlations be- 
tween the measures of learning ability and subject matter 
achievement, so evident in "conventional instruction," 
continue to exist in programed instruction. 

This is not to say that the possibilities of more 
adequately meeting the problem of differences in learner 
characteristics through programed instruction have been 
fully investigated. It is reasonable to hypothesize at 
this time that any utilization of programed instruction 
must recognize the effects of individual differences. 

Thus, there is need for further analyses of the rela- 
tionship between the variability of behavior among learners 
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in programed instruction and differences in learner 
characteristics* 



Problem 

This study was an extension of the Cooperative Re- 
search Project No* 2284, Methods of Programed Instruction 
Related to Student Characteristics (Woodruff, Shinttbukuro, 
and Frey, 1965), involving a re-examination of the data 
in the light of different set of hypotheses* These hypo- 
theses grew out of the original data analysis* 

The original study was concerned with (1) the effects 
of four methods of implementing programed instruction, and 
(2) the effects of certain learner characteristics on 
programed instruction* The effects were measured along 
two dimensions: (1) subject matter achievement over 

program content, and (2) performance on the program itself* 
"Performance" was operationally defined as the learner's 
frame to frame responses* 

The four methods studied involved combinations of 
(a) in-class or out-of-class work on programs, and (b) 
teacher or student regulated scheduling of discussions 
and tests* 

The individual learner characteristics included the 
intelligence quotient, creativity measures, the reading 
ability level, and the past school achievements of the 
individuals involved* 
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The study proceeded in terms of four sub— problems, 
(1) In terms of subject matter achievement, which method 
brings about the most learning? ( 2 ) Is subject matter 
achievement through programed instruction affected by 
individual learner characteristics? (3) Is performance 
on the programed instruction affected by the method of 
utilization employed? (4) Is performance on the pro- 
gramed instruction affected by individual differences 
in learner characteristics? 

The completed programs from the original study, con- 
taining the frame by frame responses of learners, were 
regarded as records of learner performance on the pro- 
gramed course. In the original study, however, the per- 
formance data were examined only in terms of the total 

i 

number of correct responses, wrong responses, and unan- 
swered frames • The frequencies were then related to 
measures of learner characteristics. 

The present study was proposed because, in the course 
of making the tabulations of wrong responses and unan- 
swered frames in the original study, several interesting 
variations were noted among the errors. These variations 
were typed as follows: 

1. There were errors reflecting on the effect of im- 
mediate knowledge of results upon learning. In- 
stances where individuals made the same error in a 
whole series of frames calling for the same res- 
ponse were noted, raising a question regarding the 
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efficiency of feedback on the extinction of unde- 
si red responses. 

2. There were errors reflecting on the relative effect- 
iveness of the various prompting techniques e 7 /i- 
ployed in linear programs. Noted were responses 
which could he considered errors for grammatical 
reasons. This raised a question regarding che 
effectiveness of syntactical prompts. There was 
reason also to suspect that the vanishing tech- 
nique produced a disproportionate number of 
errors, inasmuch as it gradually increases the 
amount of writing per frame. Closer examination 
of the type of prompt used in error frames, it 
was thought, could reveal other important rela- 
tionships. 

3* Finally , there were numerous instances of careless 
inattentive work on the programs. These could be 
designated as symptoms of boredom, i.e., blocks 
of unanswered frames, use of initials, ditto marks, 
and illegible scrawling and doodling. The 
tabulation of these instances of boredom could 
reveal important insights into the question of 
motivation in programed instruction. 

The purpose of this study was to see whether or not 
the types of errors noted above were significantly related 
to differences in learner characteristics. The problem 
was further delineated into sub— problems as follows; 

1. Is there significant variability in the effect of 
immediate knowledge of results when related to 
individual differences in learner characteristics? 

2. Are there significant differences in the effect- 
iveness of various prompting techniques when related 
to individual differences in learner characteristics? 

3. Are there significant differences in the incidence 
of boredom symptoms when related to differences in 
learner characteristics? 

4. Is the variation in the rate of boredom symptoms 
over time significant when related to differences 
in learner characteristics? 
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▲s can be seen from the above sub-problems, this 
study sought to analyze the variability of behavior among 
learners in programed instruction in greater detail than 
is usually done. It was expected that such an investigation 
would lead to further knowledge regarding a fundamental 
issue in programed instruction: Does programed instruc- 

tion provide adequately for individual differences among 
learners? Another expectation was that the analyses of 
performance data would demonstrate a need and the tech- 
niques, for obtaining field test results other than the 
usual pre-post test gain scores and error rates, espe- 
cially where satisfactory randomization of errors is not 
achieved in field testing. Finally, it was expected that 
useful knowledge would be gained in adapting the construc- 
tion and utilization of constructed answer type linear 
programs (the most numerous type on the market today) to 
learners with varying characteristics. 

Related Research 

Individual Differences and Achievement 

Although this study is primarily concerned with per- 
formance measures, the research relating achievement and 
individual differences are reviewed here because they 
bear fundamenta 1 ly on the problem of individual differences 
and programed instruction. 
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No significant correlations between aptitude and 
achieYement in programed instruction were reported by 
Detambel and Stolurow(1956) , Ferster and Sapon(1958), 
Gange(1962), Coul8on(1962) , Hough and Revsin( 1963), and 
Williams and Levy(1964). Small negative correlations were 
found by Porter(1959) and Keislar(1959) between IQ and 
program effectiveness. Both Meyer (i960) and Feldhusen and 
Eigen(1963) found that reading level as a measure of 
learning ability did not account for much of the learning 
in programed instruction. Further, Brown(1962) was moved 
to suggest, in the light of comparisons of achievement be- 
tween groups using programed materials and groups using 
"conventional" materials, that similar levels of achieve- 
ment could be expected from learners of varying abilities 
through programed instruction. Glaser and Reynolds(1962) 
strongly implied in their study on the relative effective- 
ness of three methods that intelligence and past achieve- 
ment measures may not be predictive of amount of learning 
resulting from linear programed sequences. 

However, other studies have tended to confirm the 
positive relationship between learning ability and 
achievement. A host of studies were reported at about 
the same time which bore out this relationship. Among 
these were Bean 9 s( 1962) study involving rote and con- 
ceptual forms of programs; Hettch and Flint* 8(1962) study 
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which evaluated academic intelligence measures as pre- 
dictors of subject matter achievement in both programed 
and "conventional" teaching; and the study by Lambert 
( 1962 ) which reported that IQ is the most significant 
variable in imnediate subject matter acquisition through 
programed instruction. Heed and Hayman(1962) reported 
that high-ability learners did better on programed 
rather than "conventional" instruction, while low-ability 
students did better in "conventional" rather than pro- 
gramed instruction. Higher retention scores on two 
retest intervals(2 and 30 weeks) we . reported for more 
intelligent students than less intelligent students by 
▲lter(1962). 

In sinmary, programed instruction research relating 
individual differences in learning ability and achieve- 
ment have produced conflicting results. Generally, the 
®*rlier studies (prior to 1962 ) tended to negate the positive 
relationship between differences in learning ability and 
subject matter achievement. Later studies (since 1962) 
have tended to demonstrate that the standard predictors 
of academic success— intelligence quotients, grade point 
averages, and reading ability — are ftlso good predictors 
of success through programed instruction. If the early 
advocates had grounds for anticipating that the problem 
of individual differences could be largely solved through 
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programed instruction, subsequent research has provided 
aiqple grounds for asserting that, if such exists in fact, 
it is still very much an unrealized potential. 

Individual Differences and Performance 

This study was devoted to the detailed analysis of 
learner performance on programed instruction. The nature 
of the learners 9 frame be frame responses in a course 
length linear program was related to certain measures 
of individual differences in learner characteristics* 
teaming Ability * The standardized measures of 
learning ability utilized in this study were the in- 
telligence quotient and reading ability. Included also 
was past achievement measures in the form of over-all 
average and average grade in science* 

The literature reviewed tended to bear out a negative 
relationship between error rate in programed instruction 
and learning ability* For example. Hatch and Flint(1962) 

f 

j found significant intercorrelations among error rate, 

I 

| criterion test performance, and intelligence* 

I 

A three part study conducted by woodruff , Faltz, 
and Wagner (1966) also reported significant relationships 
between performance and learning ability* In part one 
of the study, it was found that the "Fast," "Average," 
and "Slow" learner groups (1) completed the programs in 
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the order of their learning ability, and ( 2 ) had average 
number of correct responses in the order of their learning 
ability* In part two of the study, the number of correct 
responses produced in a spelling program were compared 
between matched pairs* Each pair consisted of a learner 
from a high reading level group, and a learner from a low 
reading level group* Of the thirty comparisons made, 
only one failed to show a markedly higher number of 
correct responses in favor of learners from the high 
reading group* Part three of the study involved person- 
ality measures and is cited later* 

The findings of the original study( Woodruff , Shim- 
abukuro, & Frey, 1965 )> of which this study was an ex- 
tension, related performance to learning ability* Its 
findings are herewith summarized* 



When one looks at the correlations between the more 
traditional educational measures of individual dif- 
ferences (i*e*, reading and intelligence measures and 
past school records), one begins to see the more 
common relationships with performance* When the 
data for all the groups are combined there are 
significant correlations among practically all of 
the variables* This would indicate that these in- 
dividual differences brought into the situation by 
the learners do affect the way they work on programed 
learning • • • 

When the groups are compared on these significant 
correlations, it is readily apparent that Groups 
III and IV, the ones under less direct supervision 
since they worked on their programs out-of-class, 
showed more of the influences of individual dif- 
ferences* Group I had no significant correlations 
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between these var tables and Group II had the next 
least number* Group III had significant correlations 
between all of them and Group IV had them among 
all but the second semester performance correlations* 
Ls©6 page 23 for a description of the treatment groups] 
This indicates that the more the student is on his 
own, the more the commonly found effects of in- 
dividual differences in the classroom will show up 
in programed learning, if his frame-by-frame behavior 
is being evaluated* 

• **The consistent finding that both the speed and 
coniprehension scores in the reading test used in 
this study are valid predictors of both performnce 
and achievement suggests that special attention 
should be paid to the reading ability of students 
who are to be assigned to or who seek enrollment 
in a programed course* The highly significant 
correlations between reading and achievement and 
performance for the year provide additional evidence 
of the importance of good reading speed and com- 
prehension* The rather high regression coefficients 
& ^ er the common variance with intelligence had been 
partialed out of reading comprehension and the total 
Gates score further emphasize this. Therefore, it 
would seem inadvisable to schedule those students 
who have demonstrated below average reading ability 
into courses which use programed instruction* On 
the other hand, of course, one should not hesitate 
in permitting good readers to enroll in such courses, 
should they so desire* It would, in fact, seem 
that as a method of instruction, programed instruc- 
tion would allow these stuoits to utilize their 
reading skills to optimum advantage in the process 
learning* 

The consistency of contribution of the nonverbal 
I*Q* score as a predictor of both performance and 
achievement cannot be ignored in assigning students 
to programed instruction. Even when the common 
variances with other predictors are partial led 
out, it still had a regression coefficient of *4o 
with year's achievement* In view of this it would 
seem that information of the type provided by a 
non-verbal intelligence battery would give some 
additional insight into the probable performance 
and achievement of a student in a programed course* «* 
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The research reviewed above leaves little doubt that 
performance of learners in programed instruction, whether 
measured as error rates or as number of correct responses, 
is determined largely by learning ability(i .e. , I.Q., 
reading ability, and past school achievement), 

r^tivity . Except for the original study( Woodruff , 
Shimabukuro, & Frey, 1965', there seems to be a dearth of 
studies relating creativity to performance in programed 
instruction. However, it was deemed useful to cite here 
studies relating programed instruction to other personality 
variables, 

Traweek(1964) found that fourth graders who were 
"successful" achievers in programed instruction in fractions 
indicated tendencies to more withdrawal, less self-reliance, 
and more signs of test anxiety, than did unsuccessful 
ones, Schoer(1966) identified 36 Ss who generated reactive 
inhibitions(RI) quickly and 36 Ss who generated HI slowly. 

He found that Ss who generated HI slowly made significantly 
more errors than those who generated HI quickly, Knight 
and Sarsenrath(l966) administered a quasi-pro jective mea- 
sure of achievement imagery, a test anxiety questionnaire, 
and an achievement pretest to 139 college undergraduates. 
These measures were related to three criteria: (1) time 
needed to complete a programed material; (2) error rate 
on the program, and (3) test of retention. The high 
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achievement motivated students scored better on all three 
criteria than low achievement motivated students • High 
test anxiety students worked faster and made fewer errors 
than low anxiety students hut failed to exhibit higher 
retention scores. Lublin(1965) found that Ss with lower 
scores on "Autonomy-need" ( Edwards Personal Preference 
Schedule) made higher scores on a criterion test than 
did Ss with high "Autonomy-need" scores. 

In part three of the study by Woodruff, Ealtz, and 
Wagner (1966) three measures of personality were taken 
for 26 nineth graders who worked on a program on Biology. 
The measures taken were the Edwards Personal Preference 
Schedule (EPPS), the Gordon Personality Inventory (GPS) , 
and the James Internal -External Scale(JIES). From the 
EPPS, only the need to achieve had a significant relation- 
ship to performance (number of correct responses). All five 
of the GPC measures were significantly related to per- 
formance, whereas none of the JIES measures were found to 

\ 

be significant. These relationships could not be regarded 
as definitive, inasmuch as the program utilized was re- 
latively short. They did, however, indicate functional 
relationships between perfonunce and the personality 
characteristics of learners. 

In the study by Woodruff, Shimabukuro, and Frey(1965), 
only a few scattered significant relationships were found 
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Ijctwscn the Torrence creativity measures and performance 
(number of correct responses). In the treatment group 
that worked in unsupervised out-of-class situations, 
however, there were 16 significant correlations, mostly 
involving the Consequences and Improvements tests. It 
was cautiously speculated that the more creative students 
would do better at working on programed instruction than 
a less creative student when the student takes the larger 
responsibility of getting the work done. 

1 consistent pattern of personality variables is 
far from discernable from the research reviewed above. 
Performance has been found to relate to self-reliance 
and test anxiety, to reactive inhibitions, to achievement 
imagery, to autonomy-need, need to achieve, and to certain 
of the Torrence creativity measures. Large gaps still 
exist in the research, and much wore will need to be 
done before the studies could be knitted into a coherent 
theory relating programed instruction with individual dif- 
ferences in personality characteristics. 

Boredom. Prompting , and Knowledge of Results . The 
present study attempted to relate individual differences 
in learner characteristics to behaviors in programed in- 
struction classified as (1) boredom symptoms, (2) prompting 
technique utilized in high error rate frames, and (3) re- 
petitive errors (see Chapter II for description of each 
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category). The literature relating to boredom, prompting, 
and reinforcement is, therefore, cited below. 

Boredom, Boredom among learners in programed in- 
struction has been reported by many users, Gotkin(1963) 
claimed that this is the most commonly stated complaint 
of students who have used programs, Thelan and Ginther 
(1964) reported that their survey showed that both low 
and high ability learners find programed instruction boring, 
especially long programs, Houston(1962) suggested a 
series of techniques for combating boredom. Among these 
were (1) using of branching; (2) combinations of Skinner 
and Crowder methods; (3) some programed adaptations of 
group instruction, and (4) breaking up of long programs 
into subunits, Mager(196l), in a study in which learners 
were permitted to control their own sequencing of in- 
struction, suggested that motivation for, and satisfac- 
tion from, learning were directly related to the amount 
of control the learner himself has on the instruction. He 
offered this as a possible explanation for the fact that 
linear programs are usually considered dull. 

Closely associated with the problem of boredom is 
the attitude of learners toward programed instruction. 

Van Atta(196l) reported that surveys of student reaction 
to programed instruction indicated that amount of repetition 
and too short steps may be causes of boredom. Banta(1963) 
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confirmed Van Atta's findings. He went further and com- 
pared student reaction toward a programed and non— programed 
text in psychology. The non-programed text was rated more 
"interesting," and more "good," hut not more "fair" than 
the programed text. The programed text was judged to he 
lacking in depth in comparf^on to the non-programed text. 
Goldberg, Dawson, and Barrett(1964) reported that beginning 
level clerical trainees found programed instruction result- 
ing in declining interest while instruction through con- 
ventional methods produced rising interest levels. Han- 
dolph(1964) found that higher ability eighth graders 
j thought a program on sets, relations, and functions was 

i 

j boring inspite of the fact that effective learning was 

observed among them, and they found the content of the 

j 

program interesting. Lindval 1(1964) , on the other hand, 
reported that first and fourth graders working on programed 

I texts were observed to be more attentive than their counter- 

| 

! parts using non-programed materials. He found that attitude 

i 

measures were not seen to relate significantly to observed 
at tention-inat cent ion nor to amount learned. 

The research herewith reviewed seems to indicate that 

| 

boredom among learners probably occurs more frequently in 
programed instruction than in the more accustomed methods 
of instruction, i.e., conventional methods. To the extent 
that causes have been speculated about, they seem to 
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involve "th© basic characteristics of th© usual Skinnerian 
linear program, e.g. short steps, repetition. The research, 
however, is devoid of attempts to identify types of learners 
who find programed instruction more or less boring, 
especially in terms of differences in learner characteristics. 
There also is the possibility that boredom in programed 
instruction, as with other methods of instruction, is 
more a problem of how and under what circumstances pro- 
grams are used than it is an inherent attribute of pro- 
gramed instruction. 

Prompting. So far as the researchers have been able 
to determine, no analyses of error relating type of prompt- 
ing used to learner characteristics has yet been made. There 
was an article, however, by Gotkin(1964) which noted that 
socially disadvantaged learners are not able to take ad- 
vantage of syntactical cues, nor are they able to relate 
responses made in previous frames to the requirements of 
subsequent frames. In this article, Gotkin argues that 
providing for individual differences in programed instruc- 
tion is more a matter of matching cognitive styles between 
programs and learners, rather than an adjustment in terms 
of branching and size of step. 

The literature also revealed several studies on the 
relative effectiveness of various prompting techniques. 
Israel(1960), for example, found chat, varying the physical 
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clarity of prompts, successively smaller amounts of 
prompting were required to attain correct responses. 
Hershberger(1964) found that typographical cueing 
(highlighting the type used for essential lesson con- 
tent), failed to enhance the effectiveness of programs 
in history and science. Hershberger and Terry (1965) 
found that typographical differentiation of core co 2 i= 
tent from enrichment content in conventional texts en- 
hances learning, and that typographical cueing in pro- 
gramed texts and programed quizzing have independent and 
additive effects on learning. Cbmpbell(196l) found 
small, non-significant differences in the effectiveness 
of two were ions of a program: one in which responses 
were fully prompted, and the other utilizing indirect 
and less obvious prompting. Angell and Lumsdaine(1962) 
found that a program using vanishing resulted in signi- 
ficantly higher delayed retention scores than did a 
program in which prompts were kept at full strength 
throughout . 

Knowledge of Results. Earlier studies have tended 
to show that learning is enhanced with knowledge of 
results. These studies involved the use of Pressey 
type testsUngell, 19^9), and instructional films 
(Michael and Maccoby, 1953) > as well as programed in- 
struct ion( Meyer, I960). They also include experiments 
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with different techniques for providing knowledge of 
results (Bryan, Rigney, and Van Horne, 1957), 

Several of the more recent studies on knowledge of 
results, however, have reported no significant differences 
(Feldhusen, and Birt, 1962; Hough, and Bevsin, 1963; and 
McDonald and Allen, 1962). Further, More and Smith(1962) 
found no significant differences when the method of in- 
forming students as to whether their responses were right 
or wrong was varied. 

The more recent studies, however, are not unanimous 
in negating the effect of i 7 siediate knowledge of results. 
Ripple(1963), for example, found that reinforced programed 
instruction was significantly more effective than the 
lecture, hut that non-re inf orced programed instruction 
was no better than the lecture. Further, it was found 
that reinforced programs produced an increase of 7 to 1 6 
percent in learning efficiency over simply reading a text 
on the same content. Likewise, Lublin(1965) confirmed the 
need for knowledge of results in programed instruction. 

Her investigation of fixed and variable ratio reinforce- 
ment resulted in better learning among the groups re- 
ceiving reinforcement than the control group which received 
reinforcement. In addition, it was found that variable 
ratio reinforcement was more effective than fixed ratio 
reinforcement • 
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Furthermore, Melaragno(1960) reported that "me sed 
negative" reinforcement depressed learning while spaced 
negative reinforcement had no depressing effect. Moore, 
and Smith(1962) found no significant differences among 
five types of immediate reinforcement. However, in a 
later study, Moore and Smith(1964) found that knowledge 
of results which also displayed the correct response 
resulted in lower error rates than simple knowledge of 
right" or "wrong." This result confirmed the result ob- 
tained by Eeurst(1964) who reported that "explanatory" 
reinforcement is superior to "non— explanatory" rein- 
forcement. 



Summary . 

The literature reviewed above is summarized as follows 

1. Programed instruction research relating individual 
differences in learning ability and achievement have pro- 
duced conflicting results. Generally, the earlier studies 
(roughly from 1956 to 1962) tended to negate the positive 
relationship between differences in learning ability and 
subject matter achievement. Later studies (since 1962) have 
tended to demonstrate that the standard predictors of 
academic success— are also good predictors of success 
through instruction. 

2. The research leaves little doubt that perfornance 
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of learners in programed instruction, whether measured 
as error rates or as number of correct responses, is 
determined largely by learning ability(i.e. , I.Q., 
reading ability, and past school achievement) • 

3. The various measures of personality, when related 
to subject matter achievement, error rates, number of 
correct responses and rate of program completion, re- 
veals that the personality make-up of learners is a 
significant factor in the effectiveness of programed 
instruction. 

4. Boredom is a common complaint among learners 
under the conditions of programed instruction. Small 
steps, seeming repetitiveness, and the high degree of 
control over the learner in linear programs seem to be 
causal factors. Overcoming boredom is largely a matter 
(1) of improving programing techniaues generally, (2) 
better adaptation to differences in learner character- 
istics, and (3) of better adaptation to differences in 
learner characteristics in the way programs are utilized. 

5* Prompting correct responses is seen as an important 
characteristic of programed instruction. Such techniques 
as vanishing and typographical cueing seem to have 
particular advantages. The research, however, on which 
prompting technique or method works well or poorly on 
various types of learners is negligible, if not totally 
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absent, 

6. The efficacy of immediate knowledge of results is 
inconclusive. Almost as many studies deny as confirm the 
significance of the contribution immediate knowledge of 
results makes on learning from programed instruction. 

With the exception of knowledge of results accompanied 
by explanatory material , the various reinforcement 
methods and schedules have no particular advantages. 

Hie research is devoid of studiet relating knowledge 
of results and type of content or type of learners. Nor 
have any studies been conducted which relate methods of 
reinforcement with learner characteristics. 

Conclusion . 

The above review of research indicates clearly that 
there are many unanswered questions regarding programed 
instruction and individual differences in learner char- 
acteristics, Aside from studies which determined the ef- 
fectiveness of existing programs among the various learner 
types and learner groups, the area of individual differences 
has been almost totally neglected. 

Gross studies designed to compare the effects of 
programing techniques, including variations in prompting, 
reinforcement, step size, presentation variables, etc, 
are no longer needed. The need is for detailed analyses 
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of where, when, with what kind of learners, with what 
kind of content and under what learning conditions is 
this or that programing methodology effective. The need, 
in short, is for studies which make strides toward the 
development of a programing technology capable of pro- 
ducing programs more closely adapted to the character- 
isticB of learners. 




PROCEDURES 



The Original Study 

Inasmuch as this study was an extension of an earlier 
study (Woodruff, Shimahukuro, & Frey, 19 65 ), a summary of 
the procedures utilized in that study is given he low. 

S ubjects . The Ss for this study were 80 eighth 
grade students of the public schools in Sandwich, Illinois 
who were enrolled in the year— long general science course. 
For a variety of reasons the final N was reduced to 7^* 

Treatment . The Ss were divided into four treatment 
groups. The treatments were varied along two dimensions: 
(1) in-class or out-of-class use of the programs; and (2) 
teacher or student regulated scheduling of the rate of 
progress through the program, discussions, and tests. Thus 
Groups I and II were in-class groups, and Groups III and 
IV were out-of-class groups. Also Groups I and III worked 
on student( individually) regulated schedules, and Groups 
II and IV worried on teacher regulated schedules. 

The programed instruction used was TMI-Grolier's 
complete course in General Science (Course TM-401). This 
course was divided into two approximately equal sections 
with students required to complete one section each 
semester of the school year. 

Data gathere d. Achievement measures were taken 
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through the administration of a criterion test at the 
beginning of the school year(pretest ) t at the end of the 
first semes ter (post test I), and at the end of the second 
semesterCposttest II). 

Performance measures were frequencies of different 
kinds of frame to frame responses made by the Ss in their 
programs. These were typed as "correct," "incorrect," or 
"blank (no response)." 

The performance and achievement measures were the 
dependent variables of the study. The independent variables 
were the measures of learner characteristics, along with 
the methods of utilization. The measures of learner 
characteristics were: (1) Intelligence quotient (Lorge- 
Thomdike, Level 4, Form 1, Verbal and Non-verbal); (2) 
Creativity (Torrence, Creative Thinking Tasks, Form BKC); 

(3) Beading Ability Level(Gates Heading Survey, Form Ml); 

(4) Over-all Grade Average, 6th and 7th grades. 

The Current Study 

This study utilized the above data to test new 
hypotheses which grew out of the initial data analyses. 

In essence it consisted of the re-examination of the com- 
pleted programs for the purpose of tabulating frequencies 
of particular types of responses. It did not involve new 
Ss nor the collection of new raw data. The following 
measures were obtained from a re-examination of the programs 
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1, Repeated errors. This measure was the number of 
instances where the same wrong responses were given two 
times or more to a series of frames calling for a parti- 
cular response. 

In order to take this measure , the entire program 
was examined to locate sections in which the same response 
was requested two times or more within an interval of less 
than 12 frames(about three pages). The sections so 
identified were examined for each S, and the instances 
where the same wrong answers were repeated were tabulated. 
Thus was obtained for each subject the total number of 
times he constructed the same wrong response even though 
he was informed the first time that he was wrong. 

2. Prompting technique. The type of prompting tech- 
nique utilized in frames were particularly high error 
rates(l4 or more or approximately 1956 error rate) was 
determined. 

In error count for each frame in the programed course 
was determined from the performance tabulation sheets of 
the original study(sheets listing the frames missed by 
each S). Bach frame having an error rate of 14 or more 
was examined to determine the type of prompting technique 
employed in it. 

The prompting techniques were categorized as follows 
(as classified in Taber, Glaser, and Schaefer, 1965): 
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a. Formal Prompts, 

1, Partial response prompts, A part of the desired 
response offered as a prompt is the classic ex- 
ample of a formal prompt, •• .Sometimes only the 
first word of a forgotten poem is enough to cue 
an entire line or stanza, ,,,In the same way, a 
frame of desired word eliminates many possible 
answers and at the same time keeps the frame 
simple, [for example] 

"Part of the word is like part of the word 
manual . Both parts come from an old word for 
hand. Many things used to he made by hand, 
facture" 

2, Bhyming prompts. Prompts of this type proride 
the student with a word which rhymes with the 
response . The rhyming prompt is a formal prompt 
in the same sense that the jjartial response is 2 
in order to rhyme with the desired response it 
must give away at least part of the formal 
structure of the response, [fpr exampliQ 

"9 times 7 and just 1 more, is 8 times 8 or ." 

3, Literal prompts. Often a single response may 
occur in the presence of several appropriate 
stimuli. For example, both the figure "3" and 
the word "three" evoke the same spoken response, 
as do both the symbol "$" and the word "dollar." 
Whenever the student has been taught to respond 
correctly to one of several stimuli which call 
for the same response, his previous learning 
may be used to extend the response to the un- 
learned stimuli, 

4, Frame structure prompts. Frequently the physical 
arrangement of a frame can be used to prompt the 
learner's response. The location of the response 
blank, for example, can serve to prompt the type 
of response desired and minimize the occurrence 
of alternative responses, [For example]] 

"Five millimeters would usually be written as: 

5 

...Another example of a structural prompt is the 
length of the response line. , .Like the physical 
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arrangement r»f the response blank, minor 
details of typography and format can pl&y 
a role in prompting the student's lesponse* 

LEor example^) 

"Greece is a peninsula in the Mediterranean 

Sea* Florida is a in the Atlantic 

Ocean* " 

...Underlining is another structural detail 
that may have prompting value* Any word in 
the body of a frame that is to serve as a 
prompt for the response may be further em- 
phasized by underlining* •• • 

b* Thematic Prompts* 

1* Pictures as thematic prompts* This type of 
prompt is introduced first because it may be 
used as either a formal dr thematic cue* A 
picture may be cued to suggest answers, or 
labil attached to the picture may serve a 
prompting function* 

2* Context-setting* When an instructor asks a 
class, "How is this principle applied in the 
design of turbin engines?" he is suggesting 
or setting a context which will evoke student 
discourse relevant to engine design and not 
flower arrangement or meteorology* By indicating 
the topic of conversation, a host of relevant 
responses assume high strength while other 
behaviors which are pertinent to other con- 
versations are reduced in immediate strength* 

In the same way, a frame can be labeled to 
suggest its context and consequently to limit 
the range of possible answers* [for example^ 

"HEARING" 

The brain "makes sense" out of the inqralses 

carried from the cociu.ea by the n erve. " 

3* Grammatical structure* If a person begins en 
utterance with the pronour "we," he immediately 
determines the form of the subsequent verb since 
his audience typically reinforces correct grammar* 
Similarly, "this" and "these" are likelj to 
be followed by appropriate singular and plural 
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forms, • .Thus , the grammar used in a frame can 
restrict the possible answers to that frame. 
Using a specific article, like "a" or "an" 
rather then nonspecific "a(n)" limits the 
number of responses tne student can make 
without violating customary grammar, 

4, Synonyms and antonyms. Synonyms and antonyms 
may be used to limit the response range by 
prompting like and opposite responses, [for 
example}) 

"Learning usually occurs when an individual’s 
response is promptly rewarded or . » 

5* Analogy, Analogies frequently serve to bring 
together aspects of a subject matter as well 
as providing strong prompts. The method of 
using such prompts is often to present one or 
more complete analogies in the text of a frame 
followed by an incomplete analogy to which the 
student responds, [for example}) 

"It is easy to learn about the Metric System 
when one thinks of the money system in rela- 
tion to it, A dollar has c ents ( penni es ) , 

A dollar has 100 cents, A meter has centi- 
meters." — 

6, Rules, Response tendencies may be set up in 
a frame by stating a general subject matter 
rule. Frequently, such frames present the 
sicatement of a rule, followed by an incomplete 
example of the rule which the student must com- 
plete, Rules may also be used to prompt other 
similar rules. The intention in using a rule 
as a prompt is not to teach the rule; this 
may have already been done or may be in process, 
R&ther, the rule is presented as a cueing de- 
vice, . • , [for example}] 

"The greatest amount of contrast is presented 
by complementary colors. Green would stand 
out best on a ______ background, " 

7* Examples, ,,.an example or particular instance 
may be used to prompt the completion of a re- 
lated example or rule. An example used as a 
prompt may be called an inductive frame, that 
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is, it leads from instance to the general 
case. In general, a rule may he used to 
prompt either other rules or examples, while 
an example may be used to prompt the comple- 
tion of other examples or the rule which it 
exemplifies. [£or example^] 

"During extinction, rats often return to be- 
haviors that were reinforced prior to recent 
conditioning. Humans, when reinforcment is 
withheld, may show behavior that has not been 
reinforced since childhood. Both cases il- 
lustrate the principle of ." 

Frequencies were tabulated for each S according to 
the type of prompting technique used in the frames he 
missed. The tabulation included only those frames missed 
which were earlier identified as high error frames. 

In addition, a frequency tabulation was made of the 
high error frames falling in each prompting category. 

3. Boredom symptoms. Boredom symptoms were opera- 
tionally defined as any attempt to shorten responses, that 
is, the use of ditto marks, initials, omitting words in 
multiple word responses, circled answers within frames, 
circled answers and lines drawn to response blank, writing 
responses less than the required number of times. In 
addition, deteriorating handwriting (handwriting quality 
dropping noticeably), blocks of 5 frames omitted in suc- 
cession, and doodles were considered as boredom symptoms. 
Frequency tabulations were made of the instances when 
such symptom*? appeared on each S's program. 

The sub-problems, together with the data associated 
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with each, are restated below. 

1. Ib there significant variability in the effect of 
inmediate knowledge of results when related to individual 
differences in learner characteristics? The data associated 
with this problem were the frequencies of repeated errors 
(feedback failures) tabulated for each S. 

2. Are there significant differences in the effective- 
ness of various prompting techniques when related to in- 
dividual differences in learner characteristics? The data 
used here were the frequencies of prompting technique 
utilized in the high error frames missed by each S. 

3. Are there significant differences in the incidence 
of boredom symptoms when related to differences in learner 
characteristics? 

4. Is the variation in the rate of boredom symptoms 
over time significant when related to differences in 
learner characteristics? The frequencies tabulated for 
each S in units located at five different points in the 
programed course were utilized in this analysis. 



RESULTS 



I, Hi© first sub-problem invest ig a ted was the following: 

Is there significant variability in the effect of 
imnediate knowledge of results when related to in- 
dividual differences in learner characteristics? 

The basic data here were the number of repeated wrong 
responses given two or more times within twelve frames in 
a series calling for the same response* They included 
either responses of the wrong word(or symbol) or words that 
were misspelled* These measures were looked at individwlly 
and combined* 

Ihble 1 presents the mean number and standard de- 
viations for each of the measures of repeated errors* 

The mean number and range of these errors were so small 
that any correlational analysis would be meaningless* So, 
it was decided to examine further the learner cha racter— 
istics of the Ss who made a number of repeat errors ap- 
proximate ly one standard deviation above the mean number 
of errors* Table 1 also presents these figures* It was 
recognized that this still gave an error score ttat was 
quite small, but might give a basis for some hypothesizing 
of possible relationships of learner characteristics and 
the effects of knowledge of results* The rationale was 
that if knowledge of results were relatively ineffective 
for certain learners, they would have a greater number of 
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repeat errors* Those Ss studied had the following number 
of repeated errors: (a) wrong responses, 8, 10, 11, 12, 

12, 19, 20; (b) wrong spelling, 4, 5, 8, 10, 11, 12; and 
(c) combined errors, 10, 11, 11, 12, 12, 12, 14, 15, 18, 

19 > 20* The examination of these Ss in an attempt to 
see if they tended to follow a particular pattern of 
measured learner characteristics showed that they were 
distributed all along the continuua being investigated* 

II* The second sub-problem studied was: 

Are there significant differences in the effective- 
ness of various prompting techniques when related 
to individual differences in learner characteristics? 

To study this only "high error" frames were used, 
these being operationally defined as those on which at 
least 20 percent of the Ss made errors of some kind* There 
was a total of 587 high error frames in the program of 7,052 
frames* These high error frames were then divided into 
those using formal prompting and thematic prompting tecl 
niques, according to the criteria stated earlier* There 
were 142 using formal prompts and 445 using thematic 
prompts* The number of errors made by the Ss on the 
high error frames using formal prompts were correlated 
with the learner characteristics and a similar correlation 
was run using the high error frames using thematic prompts* 
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Tfeble 1 

Repeated Errors: 

Mean Number and Standard Deviations 

Each Type 
(N = 74) 





Tyne of Errors 

Wrong 

Responses Spelling 


Combined 


Mean no* of errors 


3.32 


1*00 


4.32 


Standard deviation 


4*16 


2*52 


4.96 


No* errors needed by 
S for special study 


7 


4 


9 


No* Ss meeting the 
criterion 


7 


6 


11 
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Table 2 presents the resulting correlations for the 
creativity measures, showing them for the total group of 
Ss and for those within each instructional group. These 
latter were included because one of the groups (Group III) 
shows the only statistically significant correlations. 
Further, a study of these, plus the other correlations 
presented for the group give an interesting pattern. Group 
III worked through their programs outside of class at 
their own rates of progress, thus, giving them the greatest 
amount of freedom. 

There are no significant correlations for the total 
of the groups or for Groups I, II, or IV. However, Group 
III shows statistically significant correlations (at P <.05 
or <.01 levels) for five creativity measures and the num- 
ber of errors on formal prompt frames, and ei^ht creativity 
measures and the number of errors made on thematic prompt 
frames. The creativity measures that were statistically 
significant in their correlations with the number of errors 
made on "high error frames " using formal prompt techniques 
were Improvements, originality(r = -.51; P<.05), Im- 
provements, total(r as -.56; P<.01), Consequences 1, 
f luency(r = -.57; P<.05), Consequences 1, originality 
(r = -.72; P<.01), and Consequences 1, total(r = -.70, 
P<.01). The ones that were significantly related to 
number of errors in "high error frames" using the thematic 
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prompt techniques were Improvements , fluency(r = -.60; 
P<*05), Improvements, f lexibility(r = -,51; P<*05), 
Improvements, original ity(r = -.58; PC, 05), Improve- 
ments, total (r = -.64; PC. 01), Consequences 1, fluency 
(r = - .68 ; PC .01), Consequences 1, originality(r = -.81; 

P < .01 ) , Consequences 1, total (r = -.80; P<.01), and 
Consequences 2, fluency(r = -.52; P<.05). 

A further examination of these correlation coef- 
ficients between creativity measures and errors on frames 
for the Group III indicates that there is a consistent 
pattern showing that there is a larger degree of negative 
relationship between the errors made on thematic prompt 
frames and creativity measures than in the case of formal 
prompt frames. The only exceptions among the 21 creativity 
measures are (a) Tin cans , elaboration where the r is -.43 
with formal prompt frames and -.31 with thematic prompt 
frames and (b) Consequences 2, originality where the r is 
• 12 with formal prompt frames and .07 with thematic prompt 
frames. Although there is this consistency, in only four 
measures are there statistically significant differences 
found between the r*a, With a t * 2.01 necessary for a 
P = *05, the following t-scores were found: Consequences 1, 
fluency, t = 2.14; originality, t « 2.13; total, t = 2.43; 
and Consequences 2, fluency, t = 2.22. Further, it can be 
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seen that this group(working outside of class at their 
own rates) is the only one that gives a consistent 
direction of relationship between errors, regardless 
of whether they are made on formal or thematic prompt 
frames. All r's are in the negative direction, except 
three. All of the other groups show both the positive 
and negative relationships, 

'fable 3 presents the correlations between ability 

i 

measures and the number of errors made on "high error 

i 

f 

i frames" for both those using formal and thematic prompt 

| 

techniques. These correlations are given for the four 

j 

| groups as well as for the total. The total group had 

j 

i 

all correlations statistically significant with all but 
one being at the P<,01 level. Group I had no statistically 
significant correlations and Group II had six; grade aver- 
ages, all subjects, with formal prompt frames; Gates read- 
ing, speed with each prompting techniques; Intelligence, 
non-verbal raw score with each prompting technique; and 
Intelligence, non-verbal I,Q, with formal prompt frames. 

All of these were at the P<,05 level. All of Group III 
correlations were statistically significant, 14 at the 
P<,01 level and the other six at P<.05* All but one 
of the Group IV correlations were statistically signifi- 
cant, with seven at the P<.01 level and 12 at P<.05. 

Both of these groups worked their programs outside of the 
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classroom, whereas, the other two groups worked theirs 
in the class. 

A further examination of the r's for the total group 
show that the relationship between the number of errors 
and formal prompt frames are greater than with the thematic 
prompt frames. Also, these differences are statistically 
significant for each measure (t-s cores ranging from 2.05 
to 2.90, with 2.01 needed for p m .05) , except in the 
cases of Gates, vocabulary; Gates, total; and Lorge- 
Thorndike, non-verbal, raw score. Looking at Groups 
III and IV, the ones which contributed the most to the 
statistical significance of the r*s for the Total Group, 
one finds the greater negative relationship between the 
ability measures and formal prompt frames, with one ex- 
ception for each group. Only one of these differences 
was statistically significant: Group III; Gates, speed; 
t * 2.71, p < .05. 

III. The third sub-problem was: 

Are there significant differences in the in- 
cidence of boredom symptoms when related to 
differences in learner characteristics? 

The basic data used for this measure were incidents 
of abbreviated responses, such as, ditto marks, initials, 
omitting words, circling answers, etc. In addition, 
deterioration of handwriting and doodling were included. 
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Table 4 

Boredc^ Symptoms: Mean Number 
and Standard Deviation of Bach Type 



Kinds of Boredom Symptom 





Shortened 

Response 


Deteriorating Omitted 
Handwriting Frames 


Doodles 


Combined 

Symptoms 


Mean 


17.85 


10.80 


9.70 


1.38 


40.68 


Standard Deviation 


45.91 


28.03 


25.44 


3.47 


72.32 


No. of symptoms needed 
by S for special study 


6 3 


38 


35 


5 


113 


No. of Sb meeting the 
criterion 


5 


9 


5 


9 


6 
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ha in the case of repeated errors , the incidence of these 
were small enough that a correlational analysis was mean- 
ingless* Table 4 presents the mean number of incidents 
and the standard deviation. Ifce same approach was used 
here as in the study of repeated errors* Because of the 
small number of incidents , any break-down into categories 
could not be made, so, only the total number of incidents 
was used* Since the correlational analysis was impossible, 
the Ss who were at least one standard deviation above the 
mean were considered for any indications of learner char- 
acteristics that might be related to boredom symptoms* As 
in the examination of repeated errors, no pattern became 
apparent, since the involved Ss were found all along the 
particular dimensions considered* However, 5 of the 6 
of the high-boredom group worked their programs in an 
in-class situation where they had little option about 
when they would be doing their work* 

The lack of any significant findings on the third 
sub-problem made the investigation of the fourth one un- 
necessary* 
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DISCUSSION OF RESULTS 

This study investigated the (a) effectiveness of 
immediate knowledre of results in extinguishing wrong 
responses; (b) the relationship between error rate and 
prompting techniques; (c) the incidence of boredom symp- 
toms, and (d) the variability in the frequency of boredom 
symptoms over time. These investigations were made 
especially with reference to differences in learner 
characteristics • 

Knowledge of Results 

The mean number of repeated errors for the 74 Ss 
was 4.32 which gave the extremely low mean rate of re- 
peated errors of .0006 percent (based on 7052 frames in 
the programed course). In the original study( Woodruff , 
Shimabukuro, & Frey, 1965) the mean number of error 
frames for all Ss was 329*22 which gave a mean error 
rate of 8 percent. There was then a large drop in the 
error rate when the number of repeated errors was isolated 
from total errors, and considered separately. In other 
words, only a very small percentage ( .008) of the mean 
number of error frames consisted of repeated errors. 

The 11 Ss who had 9 or more repeated errors (ap- 
proximately one standard deviation above the mean of 
4.32) were selected for the purpose of analyzing their 
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learner characteristics* The 11 constituted only 15 
percent of the total N, and the frequency of 9 used as 
the cut-off point was still less than 2 percent of the 
mean number of error frames (329 .22). Further, the 11 
Sb selected showed no consistent pattern of learner 
characteristics • 

It can be seen from these results that repeated 
errors contributed very little to the number of error 
frames* It does seem that knowledge of results was very 
effective in extinguishing wrong responses in the pro- 
gramed course employed in this study* Further, the 
relationship between error rate and learning ability 
found in the original study was not reflected in the 
results of this study* 

These results tend to confirm, in terms of the 
frequency of repeated errors, the findings of Ripple(1963) 
and Lublin(1965) in which they demonstrated the importance 
of knowledge of results* They also are consistent with 
Moore and Smith 9 n(1964) results in which knowledge of 
the correot response was seen to be effective* 

In the program utilized in this study, knowledge 
of results was provided 'n the form of the correct re- 
sponse located in the left half of a space just below 
each frame* A cut-out mask was used to cover the correct 
response while the learner's response was being constructed 
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on the right half of the space* This method afforded 
▼ery little control over (a) peeking at the correct 
response before constructing it, or (b) paying attention 
to the correct response after the response was made* In 
▼lew of this lack of control over these contingencies, 
the findings of this study relative to the effectiveness 
of knowledge of results in extinguishing incorrect re- 
sponses cannot be considered conclusive* On the other 
hand, there was no indication in this study that much 
peeking actually took place* 

Uarkle(1964) suggested two situations when knowledge 
of results would be needed in instruction: (a) when a 
learner is certain that his answer is correct, but in 
fact it is incorrect, and (b) when a learner is correct 
but is uncertain that he is. A third situation could be 
added to the above; that is, when a learner is uncertain 
about the correctness of his response, and is, in fact, 
incorrect* Where the method of providing knowledge of 
results leaves so much under the control of the learner 
himself as it did in this study, when a learner is cer- 
tain about his answer when he is actually wrong, he is 
likely not to pay attention to the feedback* This, how- 
ever, did not seem to be a problem in this study. On 
the other hand, it is reasonable to assume that it is 
when a learner is uncertain about his answer that he is 
most likely to peek at the correct answer provided before 
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I 

i 
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t 

* 

making his own response. This would reduce the possibility 
that he would make an erroneous response that would need 

| to he extinguished. Although it is possible that the low 

1 

rate of repeated errors obtained in this study was due to 
"peeking* of this sort, there are no data available to 
indicate r,his. 

Prompting Techniques 

When the number of errors made on formal and thematic 
prompt frames were related to learner characteristics, 
there were very few statistically significant correlations 
found for the two groups of students who worked their pro- 
grams during the regular classroom periods. The signifi- 
cant r f s found for these two groups probably could be re- 
garded as chance factors in operation. However, in the 
two groups who worked their programs in the more independent 

I 

i 

J situation outside of the olassroom, there were a number of 

statistically significant correlations found. When the 
more traditional ability measures were used, both the 
group that worked on self-determined schedules and the 
one that worked on a teacher-determined schedule showed 

i 

significant negative r # s. When the creativity measures 
were used, the most independent grcup(oui-ox -class and 
self-determined) schedules showed a number of significant 
negative r f s. 

These findings might be easily predicted in terms of 
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the more able students would he expected to make fewer 
errors, regardless of the prompt technique used. However, 
the remainder of the findings might not he as easily pre- 
dicted, especially those involving the creativity mea- 
sures. 

When the ability measures are correlated with 
formal prompt frames and then with thematic prompt ones, 
it is shown that there tends to he fewer errors made on 
the formal prompt frames. This is true for both the 
self-determined and teacher-determined scheduled groups. 
However, for the most independent group(out-of -class 
and self-determined schedules) the tendency is for fewer 
errors on the thematic prompt frames. It would seem that 
the more creative student, when in a situation of much 
independence, works harder on the frames that do not 
have the correct responses embedded in them. This may 
be because the formal prompts are not as "challenging” 
and do not receive as much attention. Whatever the 
mechanism involved, these consistent data should have 
some pragmatic significance if one is trying to fit a 
program to the individual student. 

Incidence of Boredom Symptoms 

Accepted as boredom symptoms were (a) attempts to 
shorten responses, e.g. use of ditto marks, initials, 
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omitted words in multiple word responses 9 circled answers 9 
and failure to write a given response the required number 
of times; (b) deteriorating handwriting, and (c) blocks of 
5 frames omitted in success ion* 

The mean number of frames containing boredom symptoms 
was 40.68. This was barely .006 percent of the total of 
7052 frames in the programed course. Even the frequency 
of 113 (one standard deflation above the mean) was only 
•002 percent of the total frames. The 6 Ss who had fre- 
quencies of 113, or over 9 was only 9 percent of all the 
Ss. Further , these 6 Ss showed no consistent pattern of 
learner characteristics. It was seen, however, that 5 of 
these 6 Ss were members of the groups who worked on the 
program in class. 

▲ measure of the incidence of boredom by quarters 
was taken. ▲ significant Chi-square was obtained indi- 
cating that there was a significant trend toward in- 
creasing frequencies of boredom symptoms in the later 
quarters, especially in the third quarter. Frequencies 
by quarters were obtained for the same 6 Ss above who had 
113 or more boredom symptoms to see whether they would 
also show the same tendency toward increasing frequencies 
in the later quarters. They tended to follow the pattern 
of the grou>. It must be remembered, never theless, that 
these frequencies were all still very small. 
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These results Indicate that boredom, as evidenced 
by ‘She particular symptoms considered, was far from a 
serious problem* There appears to be an inconsistency 
here with Gotkin(1963) and Thelan and Ginther(1964) 
who reported that learners frequently complain of being 
bored by programed instruction* There appears also to 
be an inconsistency with those who have reported that 
boredom is caused by the inherent characteristics of 
linear programs, i.e., Van Atta(196l) who claimed that 
repetition and too short steps caused boredom, and ifeger 
(1961) who held that motivation was a function of the 
degree of control a learner has over his own instruction. 

These inconsistencies, however, may be more apparent 
than real. Understanding that there frequently is a per- 
iod of build up of covert feelings of boredom before 
overt expressions are made, and taking into consideration 
that there was a significant trend toward increasing fre- 
quencies over time, it could be hypothesized that there 
was a latency factor operating here; that is, the in- 
cidence of boredom symptoms might have been much higher 
had the programed course been longer and/or the experiment 
extended over a longer period of time. This hypothesis is 
supported somewhat by the fact that, in the original 
study, a significant drop in favorable attitude toward 
programed instruction and a significant drop in achievement 
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was noted in the second semester( Woodruff , Shimabukuro, 

& Frey, 1965). However, remembering that this study 
took place over an entire school year, this hypothesizing 
is more rhetorical than practical. Ordinarily programs 
would not be used over a longer period of time without 
some extended "rest interval,*' such as summer vacation. 

Another consideration is the fact that this study 
accounted for boredom as measured by the frequency of 
boredom symptoms actually appearing in the completed 
programs. There are other symptoms of boredom that are 
never recorded permanently, e.g. daydreaming, looking 
out the window, "horsing around," dozing, etc. It is 
possible that had measures of such symptoms been avail- 
able, boredom would have been found to be a problem. 

On the other hand, the increasing frequency of bore- 
dom symptoms in the later quarters might have been caused 
by factors other than time. For example, it could have 
been a function of the nature of the subject matter, or 
the difficulty level of the treatment of the material. 
Moreover, programed instruction research is focused on 
overt responses to specific stimuli — on what the learner 
actually does in response to particular frames. On this 
basis, it is stated that boredom was not found to be a 
serious problem in this study. 



SUMMARY, CONCLUSIONS AND RECOMMENDATIONS 



SUMMARY 



Problem and Procedures 

This study was an extension of the Cooperative 
Research Project No* 2284 in which methods of program 
use was related to learner characteristics* In this 
extension, new hypotheses growing out of the original 
data analysis were investigated* 

The hypotheses were stated in terms of sub— probl e ms 
as follows: 

1. Is there significant variability in the effect 
of immediate knowledge of results when related 
to individual differences in learner characteristics? 

2* Are there significant differences in the effective- 
ness of various prompting techniques when related 
to individual differences in learner characteristics? 

3* Are there significant differences in the incidence 
of boredom sympt' us when related to differences in 
learner characteristics? 

The original programs containing the Ss frame by frame 
responses were re-examined to provide the measures needed 
to test the null hypotheses implied in each of these 
sub-problems • 

Results 

Sub— problem ^1, The effect of knowledge of results 
with respect to the extinguishing of incorrect responses 




was the object of this analysis. The measure was fre- 
quencies of wrong responses that were repeated one or 
more times. 

The frequencies obtained were so extremely small 
that it made correlational analysis meaningless. The 
mean number of repeated errors was 4.32 with a standard 
deviation of 4,96, In relating this measure to learner 
characteristics , Ss were selected who had repeated errors 
of 9 or more. The Ss so selected showed no consistent 
pattern of learner characteristics. 

Sub-problem #2. In this analysis an attempt was made 
to see if the learner characteristics were related to the 
effectiveness of formal prompt or thematic prompt techni- 
ques. 

It was found that there were meaningful relationships 
here in situations where th6 student was working the pro- 
gram on his own( out-side of class). It was found that 
those who were higher in the more common ability measures 
(working on his own) made fewer errors on the formal prompt 
frames. The situation where creativity measures were 
significantly related was under conditions of greatest 
independence (out-of -class and self-determined schedule). 

The group working under these conditions made fewer errors 
under the thematic prompt technique. 

Sub-problem #3* The number of frames containing 
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boredom symptoms were tabulated for each S. The mean 
number of such frames was 40.68 with a standard deviation 
of 72.32. mis was a mean rate of only .006 percent(of 
the total of 7052 frames), and indicated a drastically 
skewed distribution of scores. Correlational analysis, 
therefore, was not deemed to be justified. 

Se were selected who had frequencies of boredom 
symptoms of 113 or more (one standard deviation above 

the mean). Ihey showed no consistent pattern of learner 
characteristics . 



CON Cl, US I US 

Ihe larger and more basic issue to which this study 
was addressed was: -Does programed instruction provide 
adequately for individual differences among learners?" 

H»is problem was pursued in this study on the basis of 
four measures: (a) frequency of repeated errors} (b) fre- 
quency of high error frames classified as to type of 
prompt utilized in it— formal or thematic, ( c ) frequency 
of boredom symptoms, and (d) frequency of boredom symptoms 
in each of the four quarters of the programed course. 

Of these four measures, only one, frequency of error 
frames classified as to type of prompt utilized was found 
to be significantly related to learner characteristics. 
Those who were higher in common learning abilities measures 





working on the programs outside of class , made fewer 
errors on the formal type prompts. Those who were high 
in creativity measures, working on the programs outside 
of class and at their individual rates, made fewer errors 
on thematic type prompts. 

The frequency of repeated errors was assumed to he 
a measure of the effectiveness of knowledge of results 
in extinguishing incorrect responses. The frequencies 
were extremely low and an examination of the character- 
istics of Ss who scored high on this measure revealed no 
consistent pattern of learner characteristics. The ap- 
parent conclusion to he drawn from these results is that 
knowledge of results, as provided in the program utilized, 
is effective in extinguishing incorrect responses, and 
that its effectiveness is not influenced hy the learner 
characteristics considered in this study. 

The incidence of horedom was likewise extremely low, 
and the Ss having the highest frequencies of horedom symp- 
toms showed no pattern of learner characteristics. In 
relation to learner characteristics, nothing significant 
was found in the incidence of horedom symptoms over time. 
It is concluded, therefore, that horedom was not a major 
problem, and that its incidence is nr a related to learner 
characteristics • 
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RECOMMENDATION S 

It was hoped that this study would provide some 
insights into the adaptability of linear programs to 
learners with different characteristics. Indeed, the 
findings of this study do seem to indicate that the 
following suggestins regarding the construction and 
utilization of linear programs would be advisable: 

1* Program construction. The continued use of 
knowledge of results which provide the correct answer 
is indicated. Initial errors produced by a learner be- 
cause the step at that point was too large for him, or 
because he did not have the initial behaviours to suc- 
cessfully cope with the frame, appear to be effectively 
corrected by this feedback technique. 

Ihe type and strength of prompt to use in a frame 
should be considered a critical issue. Neither formal 
nor thematic prompts by themselves overcome the influence 
of learning ability on error rate in programed instruc- 
tion. Ihe control of step size through the use of prompts 
is likely to be the key factor in the adaptation of pro- 
gramed instruction to differences in learning ability. 

The impression that a frame with formal prompts is easier 
than a frame with thematic prompts is likely to be more 
apparent than real. 
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The obvious use of vanishing should he avoided. 

The systematic tabulation of boredom symptoms and re- 
peated errors in relation to vanishing was not made in 
this study. However, it appeared to the researchers 
that sequences of frames in which the verbatim memori- 
zation of definitions, or statements of principles and 
generalizations, was being taught through the vanishing 
techniaue in which a few additional words are removed 
in each subsequent frame until all significant words are 
removed in the final frame in the sequence, produced more 
boredom symp+oms than other frames. In this connection, 
frames which simply instructed the learner to write a 
word several times so that its spelling could be mastered 
seemed also to produce more signs of boredom. Such obvious 
and meaningless requests for the repetition of responses 
should be discouraged. Responses need to be repeated in 
order to be strengthened, but this should be done through 
subtle and interesting variations of stimuli. 

2. Program utilization, The original study Indicated 
that achievement and performance were significantly re- 
lated to learning ability. In this study, it was found 
that the effectiveness of formal and thematic prompts were 
significantly related to learning ability, but that this 
relationship wae established by the groups who worked on 
Programs outside of classroom situations in the absence 
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of direct supervision from the teacher. These two 
studies provide a complement of results which indicate 
that only the higher ability students should be per- 
mitted to work on programs in out-of-class situations. 

Lower ability, and poorly motivated, learners should 
work on programs in in-class and more closely super- 
vised situations. The creativity measures were found 
to be significant only in the one instance— among the 
group in out-of-class and self-directed situations, and 
only in relation to the effectiveness of formal and thematic 
prompts. It would appear that the freest instructional 
situations in which learners are given maximum opportunity 
to direct their own work on programs should be reserved 
for high ability learners who are also the most creative. 
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SuBTApy of scores of All Subjects 
On All Measures 
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SOUND 



Unit Formal 



Thematic 



1 

2 

I 
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3,8,15,24 

13 

11,12 
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4 
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1 
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^3,132, 155, 156, 16 °, 163, 164, 165 
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1 

3 25,52 

4 
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6 7,8 

8 1,26 



MEASUREMENT 
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66*67,70,80,75,91,92 

3 
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25 

2,3,4,5,6,7,8,20,24,25,32,35,36 
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METEOROLOGY 
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8 

9 

10 

11 

12 
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,38,45,67,72,73 

2 , 64 , ££,£ 0 , 50,94 
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51 



ASTRONOMY 



1 

3 

4 

5 

6 

7 

8 

9 



18,75 



22 

19 



73 

11,113,115,125 

59,102 

98 

3*, 39 

G3, 6l, 79, 80,86,87, 88,89, 90 
54,72 



27,35 



WORK AND MACHINES 



1 

2 

3 

4 

5 



6 

7 

8 
9 

10 



143,145 

17.45.47 

6.11.47 
80,100 

22,23,91,95,97 



8 

65,100,110,120,126,178 

181,185,186,192,210 

10 

9 

15,28,123,125,155,156 



26.27,101,110,132,135,144,155,174 

184,188,201 

12,32,33,35 

14.32.43.55.65.69.70.75 
17,20,21,36,40,41,42,45,51,59,68,84 
9,38,69,72,76.77,79,112,117,133,135 
136, 139, 140, 141 ,142, 146, 148, 149 ,150 
151,152.153,154 

16.22.34.37.50.57.65.68.70.71.74.75 
76,79,85.87,88,89,96,97,101,103 

33, 129, 140, 142, 146,162,163, I89, 206, 215 



2,14,21,29,42,43,47,48,50,67,68,70,74, 

75,79,80 

1,27,30,36,48,50,51,61,62,7: 86,87,94 

95,100,103,110,114,121,126,129,130,135 

136,137,139,140,143,145,150,152,153,15; 




66 



BIOLOGY 



1 

2 

3 

4 
6 
7 

9 

10 

11 

12 

13 

14 



38,72.91,106,112,113 

115,1% 

18,19 

6 

12,15 

5 

30,43,101,119,124,128, 

138,143 

61,78 

81,94,106 

82,96,132,133,187 



68,103 

18,94 



10,28,33,46,48,53,54,59,68,76,95,97 

102,122,123,139,144,148 

3,14 

10,16,17,18,19,22,23 

6,34,43,65,70 

18,19,36,97,112,117 



56,72,92,98 

37,63,65,70,73,79.80.83,90,101,103 

29,57,58,63,164,175,177,189,203,204 

211,213 

8 



33,37,69,72,78,81,82,85,87,89,93,100 

101,105,114,115 

32, 3^,35,36, 38, 40,48,49, 62, 64,70, 73, 75 
81,83,82,85,88,89,93 



Cl 



I5T.I 



STRY 



1 

2 29 

3 14,17,19 , 

4 52,59,60,61 

5 

6 7 
8 

9 

10 28,39 

11 

12 20,36 

lj* 8,34,45,51,86,87,90 

15 '49 



7,25,95 



35,54,62 

17,25,27,30,45,53,67 

17 

20,42,48 

27 

20,21,29,37,40,48,49 

39,54,55,66,61 

19,30,35,37,38,39,40 

57,59,60.77,79,85,93,95 

4,18.31,43,44 

37,44,56 





Appendix B 



Classification of High Error Frames into Formal 
or Thematic Prompt Techniques 
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NOTE: On the tables in Appendix B, the key to variable identification 

is as follows: 



Variable Name 



CREATIVITY MEASURES 



Circles, Fluency 
" , Flexibility 

" t Originality 

" , Elaboration 

" f Total 

Improvements, Fluency 

" , Flexibility 

" » Origniality 

f Elaboration 
" , Total 

Tim Cans, Fluency 
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" , Total 



Variable No. 
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Variable Name 

LEARNING ABILITY MEASURES 



Variable No. 



If 
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It 



It 
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28 


, Verbal I.Q, 


29 
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